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(57) Abstract 

In a method of fair queue servicing 
at a queuing point in a multi-servicc class 
packet switched network, incoming packets 
are received in buffers and outgoing packete 
ait scheduled by a weighted fair queue 
scheduler. Real-time infomiadon of buffer 
usage along with the minimum bandwidth 
requirement is used to dynamically modify 
the weights of the weighted fair queue 
scheduler. 
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Fair Queue Servicing using dynamic weights (DWFQ) 

This invention relates to the field of telecommunications, and more particularly to 
a method of fair queue servicing in asynchronous data networks, such as Asynchronous 
Transfer Mode (ATM) networks or more generally any packet svwtched network that 
supports more than one class of service. 

The use of ATM by a continually increasing number of applications is driving a 
requirement to increase the number of service classes and to allow more flexibility in the 
service offerings. To support the application requirements, the ATM Forum is adding 
new service categories in new releases of ATM specifications. Furthermore, network 
providers are looking for the flexibility of defining multiple service classes for a given 
service categon . The service classes are differentiated by their Quality-Of-Service 
requirements (QoS). The QoS requirements are configurable in accordance with a bi- 
dimensional mauix describing loss and delay. The delay jitter is another factor which 
needs to be bounded for some service classes. 

Previously, three service categories were supported on an ATM network element, 
namely constant bit rate (CBR), variable bit rate (VBR) and unspecified bit rate (UBR). 
The CBR service is the only service that guarantees a bound on delay. It is used for time 
sensitive data, such as voice and video. 

These \ arious services can be supported by traditional exhaustive round-robin 
queuing among two priority queues. However, this simple technique cannot be used 
when the number of queues increases beyond two, because of the high potential of 
starvation for lower priority queues. Furthermore, the exhaustive round robin can only 
guarantee bounds on delay and delay variation for the highest priority queue. The support 
of multiple service class in an ATM switching product or multiplexer requires a minimum 
of one queue per class. 

A queue scheduling algorithm. Weighted Fair Queuing (WFQ), has been recently 
proposed in the literature (see S. Golestani, A self-clocked Fair Queuing scheme for 
broadband applications. INFOCOM 1994. June 1994). 
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This scheduling scheme allows any number queues (service classes) to be 
serviced, while providing fair and work conserving access to bandwidth. One of the key 
features of WFQ is that the CDV (Cell Delay Variation) is bounded for any service class, 
as long as it is given a minimum weight. 

This proposed scheme can be implemented in ATM products. However, it has not 
been determined how to set the servicing weights efficiently to take into account the 
dynamically changing bandwidth requirement of each service class (connection 
addition/removal, ABR flow control, Early packet Discard). 

An object of the invention is to provide a framework that ensures that the weights 
are set appropriately to guarantee the desired Quality of Service and modified in real-time 
to ensure that the dynamic allocation of bandwidth across the classes is optimized. 

According to the present invention there is provided a method of fair queue 
servicing at a queuing point in a muhi-service class packet switched network, wherein 
ijicoming packets are received in buffers and outgoing packets are scheduled by a 
weighted fair queue scheduler characterized in that real-time information of buffer usage 
along with the minimum bandwidth requirement is used to dynamically modify the 
weights of the weighted fair queue scheduler. 

Preferably tlie minimum bandwidth requirement is extracted during connection 
admission control. 

The method is particulariy suitable for use in ATM networks. 

The DWFQ (Dynamic Weighted Fair Queuing) can be implemented at any 
queuing point which arbitrates servicing between n queues (n>2). 

The invention also provides a fair queue servicing arrangement in a multi-service 
class packet switched network, comprising a weighted fair queuing controller, and buffer 
means for receiving incoming packets in queues, characterized in that further comprises 
means for monitoring buffer usage for each queue, means for determining the bandwidth 
requirements of each class of service, and a service weights manager for dynamically 
modifying the weights of said weighted fair queuing controller means in response to said 
buffer usage and bandwidth requirements. 
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Preferably, the means for monitoring buffer usage a queue growth monitor which 
performs real-time estimation of the queue growth in said buffer means. 

The invention will now be described in more detail, by way of example only, with 
reference to the accompanying drawings, in which:- 

Figure 1 is a diagram depicting the high level queuing scheme at an ATM switch; 

Figure 2 shows the information provided by the Queue Growth Monitor; 

Figure 3 illustrates the data flow between the key components of the system and 
the action of the Service Weight Manager (SWM); and 

Figure 4 describes the process performed by the SWM. 

Referring now to Figure 1, ATM cells 2 arrive at buffer 1 and are placed in queues 
1 ' j\ ... r. From there the cells are passed to a weighted fair queuing unit 3. The buffer 1 
is also connected to a queue growth monitor 4, which in turn is connected to congestion 
control unit 5, congestion analyzer 6, and connection admission controller 8, which in 
turn is connected to SVC & PVC (Switched Virtual Circuit and Permanent Virtual 
Circuit) connection handling unit 7, and service class manager 10. Queue growth monitor 
4, connection admission controller 8 and service class manager 9 are connected to service 
weights manager 9, which is connected to weighted fair queuing scheduler 3. 

The key element of the Dynamic Weighted Fair Queuing (DWFQ) scheme is the 
service weight manager (SWM) 9, which d>Tiamically modifies the service weights to be 
used by the WFQ Scheduler 3. It uses real-time information from the service class 
manager 10, the connection admission controller 8, and the Queue growth monitor 4. 

The service class manager 10 configures the service classes. A service class is 
configured with a given value of delay (CTD - Cell Transfer Delay) and loss (CLR - Cell 
Ratio Loss) requirements. These parameters represent the maximum nodal delay and loss 
allowed in order to meet the end-to-end QoS requirements of the connection. The service 
classes are mapped into a priority table as exemplified in Table 1 . The priority table is 
used later by the service weight manager to allocate remaining bandwidth. The priority 
table is updated when a service class definition is modified. The service class manager 
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Queuei 


Category 


TOSi 


Ql 


CBR 


CTD/min Wi 


Q2 


RT-VBR 


CTD/min Wi 


Q3 


NRT- 
VBR 


0 


Q4 


UBR 


0 


Tab 


e 2» Example ofa target queue size computation. 



The Queue Growth Monitor (QGM) 4 performs real-time estimation of the queue 
growth every Ts cell slots (sampling interval). The information provided by the Queue 
Growth monitor 4 to the SWM 9 consists of AQi, the Queue Growth^Rate of output queue 
1 during an interval of duration Ts, Qi, the length of output queue i at the sampling time, 
and Ai, the arrival rate during the same interval of time. 

The corresponding parameters: queue size Qi, queue growth AQi, number of 
arrivals Ai are collected or each queue by the QGM 4 for each Ts interval. From these 
parameters, auxiliary parameters such as average arrival rate ^1 and service rate |ii can be 
-derived by the SWM 9: 

Xi : average arrival rate, X\-A\^ Ts 

|ii : average service rate, Hi = Sj ^ Ts, where Sj = Ai - AQi is the number of cells 
served during Tj. 

Figure 2 shows the information provided by the Queue Growth Monitor 4. Using 
this information for die CAC 8, the service class manager 9 and the queue growth monitor 
4, the SWM computes the service eight for each queue / (Wj) to be used during the next 
sampling interval. 

As can be seen in Figure 3. which shows the data flow between the key 
components of the system and the action of the SWM 9, the queue weights, Wi, are 
updated using information provided by the Queue Growth monitor 4. 

If denotes the arrival rate of cells in queue / in the coming Tj interval, then 
ideally, the target service rate \i- can be calculated as: - T = Q. -TQS^. This 
means at the end of next Ts interval, the queue size Qi will reach the target queue size 
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also dictates which traffic descriptors are used to compute the minimum bandwidth 
required by a connection of a given class. 
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Table 1 • Example of a Queue Service Priority Mapping. 

The connection admission controller (CAC) 8 computes the minimum bandwidth 
required for each service class. The minimum bandwidth is updated each time a 
connection of a given class is established or disconnected, based on its traffic descriptor. 

Table 2 shows a typical example of which traffic descriptors that can be used to 
compute the minimum bandwidth for each basic service category relative to the queue 
service rate (SR). The CAC 8 communicates the minimum Weight table to the SWM 
ever)' time the value of the minimum weights have changed by a factor of 
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Table 2 • Example of minimum weight table. 

The CTD is further taken into account in the target queue size (TQS) table, which 
is the maximum queue size allowed to limit the CTD. An example of TQSj computation 
is shown in Table 3, for typical service categories. A zero TQS indicates that the queue 
can grow without limitation. This table is computed by the CAC. 
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TQSi. On the assumption that Xj remains unchanged from X\ , the service weight 
W , = (I j • can be approximated as 

W . = A. • = ^. • + - TQS, = A. + Q. - TQS. . 

However, the assumption on the stable arrival rate may not hold, and also the 
actual number of serviced cells Si could be less than Wi; therefore a more conservative 
approach is AQ, > 0, then Q,+AQi, the predicted queue size at the end of the next Ts 
interval, is used to calculate the target service rate and weight. That is: 

(ii,-X,)T,=Q.+AQ,-TQS. and 
W. -X. -T, +Q; + AQ,-TQS. = A, + Q, + AQ, -TQS. 

The detailed algorithm performed by the service weights manager 9 is shown in 
Figure 4. The queue size Qj at the end of each interval Ts, the number of arrivals Aj during 
the previous interval Ts, and the change in queue size AQi are input at step 20. Step 21 
determines whether the queue growth is positive: if yes, the service weight Wj is 
conservatively adjusted to bring the queue size to TQSi at step 22; if no, the service 
weight Wj is adjusted to bring the queue size to TQSi at step 23. The difference AW is 
deiemiined in step 24, 

Step 25 determines whether the shared weights pool is empty: if yes, Wi is set to 
min_Wi in step 26; if no, step 27 determines whether Ws > AWj: if yes, step 28 sets Wj = 
min^W, + AW, and Ws = Ws + AW,; if no, step 29 sets Wi= min_Wi + Ws and Wj = 0. 

Step 30 runs through all the Wj in the ordered list L and step 31 updates the weight 
table used by the Weighted Fair Queuing scheduler 3. 

The described technique complies with ITU and ATM Forum standards and can 
be applied to any switching equipment which suppons more than a single serv ice class of 
service. 
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Claims: 



1 . A method of fair queue servicing at a queuing point in a multi-service class packet 
switched network, wherein incoming packets are received in buffers and outgoing packets 
are scheduled by a weighted fair queue scheduler characterized in that real-time 
information of buffer usage along v^th the minimum bandwidth requirement is used to 
dynamically modify the weights of the weighted fair queue scheduler. 

2. A method as claimed in claim 1 , the minimum bandv^dth requirement is extracted 
during connection admission control. 

3. A method as claimed in claim 1 , characterized in that said weights are also 
modified in accordance with real-time service class information. 

4. A method as claimed in claim 1, characterized in that buffer usage is monitored by 
a queue growth monitor, which performs real-time estimation of the queue growth every 
sampling interval Ts. 

5. A method as claimed in any of claims 1 to 4, wherein said packet switched 
network is an ATM network and said packets are ATM cells. 
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6. A method as claimed in any of claims 1 to 5, wherein the weights of the weighted 
fair queue scheduler are modified in accordance with the following algorithm: 



From the Queue growth monitor: 
Qi : queue size at the end of Ts 
Ai : number of arrivals during previous Ts 
^Qi: change of queue size during previous Ts 



Weights Re-calculations per Ts 
Yes 



Queue Growth Positive ? 
SQi > 0 ? 




Conservaliveiy adjust service weight to 

bring queue size to TQSi. 

Wi = max ((Ai -^ Qi - TQSi). mln_Wi} 



Adjust service weight to bring queue 
size to TQSi. 

Wi - max {(Ai + Qi - TQSi). min_Wi} 



AWi - Wi - min_Wi 









Weights Enforcements 

Yes ^^SharedWeights\. No 



Wi = min Wi 




Wi = min^Wi + Ws 
Ws = 0 



No 




Wi - min_Wi +^i 
Ws = Ws fiWt 



Go through all the Wi 
^ the ordered list L ? 

Yes 



Update weight table to be used by WFQ in the next Ts 



wo 97/14240 



PCT/CA96/00681 



.9- 

7. A fair queue servicing arrangement in a multi -service class packet switched 
network, comprising a weighted fair queuing controller, and buffer means for receiving 
incoming packets in queues, characterized in that further comprises means for monitoring 
buffer usage for each queue, means for determining the bandwidth requirements of each 
class of service, and a service weights manager for dynamically modifying the weights of 
said weighted fair queuing controller means in response to said buffer usage and 
bandwidth requirements. 

8. A fair queue servicing arrangement as claimed in claim 7, characterized in that it 
further comprises a service class manager which stores the cell transfer delay cell loss 
ratio requirements for each class of service, and said service weights manager is also 
responsive to said class of service requirements stored in said service class manager to 
dynamically modifythe weights of said weighted fair queuing controller means. 

9. A fair queue servicing arrangement as claimed in claim 8, characterized in that 
said means for monitoring buffer usage comprises a queue growth monitor which 
performs real-time estimation of the queue growth in said buffer means. 

10. A fair queue servicing arrangement as claimed in claim 8, characterized in that 
said queue growth monitor outputs to said service weights manager the queue growth rate 
of each output queue / during a sampling interval, the length of the output queue / at 
sampling time, and the arrival rate of cells Aj during the sampling interval. 

11. A fair queue servicing arrangement as claimed in any of claims 8 to 1 0, 
characterized in that said network is an ATM network. 
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Ts: Sampling interval 

Wi: service weight. Number ot cells to be served in T's tor output queue i. 



From CAC and the service class manager. 

min_ Wi: minimum service weight table 
TQSi: Target Queue Size table 
L: Queue Service Priority List (Sorted) 



Order 



Q2 



Q n 



Reserved Weight: 
Imin Wi 



Shared Weight Pool: 
WS=Ts-Imin_Wi 



From the Queue Growth monitor (every Ts): 

Qi: queue size at the end ofTs. 
Ai: number ot arrivals during previous Ts 
AQi: change of queue size during previous Ts 



SWM updates All Queue Weights after one Ts: 
(see Figure 4 for detailed algorithm 

(1) Queue growth rate AQil 

arrival rateAifAWi 

queue size QiJ 

(2) Wi = min_ Wi, guarantees minimum weight, 
provides protection for high priority queues 

(3) Further allocate the A Wi to Wi in the priority 
order, specified by list L: 

Wi = wi+AWi, if Shared Weight Pool isn't empty. 
Wi = min_Wi, otherwise (Ws = o). 



FIG. 3 

ri rnrrm rrc cuccT /Dl 11 C 0R\ 
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From the Queue Growth monitor : 
Qi: queue size at the end ofTs. 
Ai: number of arrivals during previous Ts 
Qi: change of queue size during previous Ts 



20 



Weights Re- calculations perTs 
YES 



22 




Conservatively adjust service weight to 

bring queue size toTQSi. 
Wi = max{(Ai + Qi+ Qi-TQSi,mln_W 



23 



Adjust service to bring queue 
size to TQSi. 
Wi = max {( Ai + Qi - TQSi, min Wi} 



AWi=Wi-min_Wi 



Weights Enforcements 
YES 



26 



= min 



NO 



FIG. 4 




Wi = min_Wi + Ws 
Ws + 0 




Wi = min.Wi +AWi 
Ws = Ws-AWi 



28 



31 



Update weight table to be used by WFQ in the next Ts 
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